[docs] AutoPipeline #12160
[docs] AutoPipeline #12160
Conversation
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
| # AutoPipeline | ||
|
|
||
| Diffusers provides many pipelines for basic tasks like generating images, videos, audio, and inpainting. On top of these, there are specialized pipelines for adapters and features like upscaling, super-resolution, and more. Different pipeline classes can even use the same checkpoint because they share the same pretrained model! With so many different pipelines, it can be overwhelming to know which pipeline class to use. | ||
| [AutoPipeline](../api/models/auto_model) is a *task-first* pipeline that automatically selects the correct pipeline subclass based on the task. It handles the complexity of loading different pipeline subclasses without needing to know the specific pipeline subclass name. |
There was a problem hiding this comment.
oh I think AutoPipelline select based on task & model; DiffusionPipeline only based on model. So AutoPipeline take just one step further, here it sounds like they are two parallel approach
so basically for DiffusionPipeline
model -> pipeline subclass
for Auto
model -> pipeline subclass ->pipeline subclass within the same pipeline group for a different task
| [AutoPipeline](../api/models/auto_model) supports [StableDiffusion](../api/pipelines/stable_diffusion/overview), [Stable Diffusion XL](../api/pipelines/stable_diffusion/stable_diffusion_xl), [ControlNet](../api/pipelines/controlnet), [Kandinsky 2.1](../api/pipelines/kandinsky.md), [Kandinsky 2.2](../api/pipelines/kandinsky_v22), and [DeepFloyd IF](../api/pipelines/deepfloyd_if). | ||
|
|
There was a problem hiding this comment.
Is Flux not supported? 👀 Maybe we could open it up to the community to add some of the recent models. Cc: @yiyixuxu
There was a problem hiding this comment.
My bad, Flux is supported! I just added a note with a link to check the mappings since the list might become quite long if we listed all the supported models.
| " | ||
| ``` | ||
|
|
||
| You can learn more about the [`~DiffusionPipeline.from_pipe`] method in the [Reuse a pipeline](../using-diffusers/loading#reuse-a-pipeline) guide. |
There was a problem hiding this comment.
The from_pipe note seems important. Do we want to remove it?
There was a problem hiding this comment.
I think it's ok not to have it here since we're not showing any code examples that demonstrate using from_pipe, so its a bit out of scope.
4 participants
Refreshes the
AutoPipelinedocs with a clearer explanation of how its different fromDiffusionPipeline.